IMAGE ENCODING/DECODING METHOD, APPARATUS THEREOF AND RECORDING 
MEDIUM IN WHICH PROGRAM THEREFOR IS RECORDED 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image 
encoding/decoding method, an apparatus thereof, and a recording 
medium in which a program therefor is recorded, and more 
particularly, relates to an image encoding/decoding method, an 
apparatus thereof, and a recording medium in which a program 
therefor is recorded, according to Hybrid Vector Quantization 
(HVQ) system. 

2 . Description of Related Art 

According to JPEG (Joint Photographic Expert Group) 
system, 8 times 8 pixel blocks are convert ed to DC (direct current) 
value and each coefficient value of from base to 6 3 times frequency 
by two dimensional DCT (discrete cosine transform) , and 
information amount is reduced by quantizing the coefficient value 
in a different quantization width within no reduction of image 
quality utilizing frequency components of natural images which 
are gathered in a low frequency range, and then Huffman encoding 
is carried out. 

According to HVQ system, which is a kind of mean value 
separation type block encoding same as JPEG, adaptive orthogonal 
transform (AOT) which is an intermediate system between a vector 
quantization and orthogonal transform encoding is used as a 
compression principle. AOT is a system in which the minimum 
number of non - or thogonal basis is selected from nests of the 
basis corresponding to a code book of vector quantization and 



the objective blocks become close to the desired and allowable 
error "Z". According to the HVQ system, decoding is quickly- 
carried because a decoding operation can be done in the form 
of integer. Natural images and artificial images (animation 
images, CG images) can be compressed in high image quality, 
because there are not mosquito and block noise, which are 
particularly generated in JPEG , and false contour, which is 
particularly generated in GIF. The invention relates to a method 
for further improving the image quality and for carrying out 
the coding operation at a higher speed in the HVQ system. 

The applicants of the invention have proposed an image 
encoding/decoding method in accordance with the HVQ system 
utilizing self - similarity of images in Japanese Patent 
Application No. 189239/98. The contents of such proposal will 
be explained as follows. In the disclosure, a sign<a>means 
vector "a" or block "a" , a sign || a || means norm of the vector "a" , 
and a sign < a ■ b> means inner product of vectors a andb. Further, 
vectors and blocks in drawings and [numbers] are represented by 
block letters . 

Fig. 1 is a block diagram showing a conventional image 
encoder. In Fig. 1, 11 is an original image memory for storing 
an original image data, 12 is a DC value production unit for 
seeking a block average (DC) value per each pixel block (4 times 
4 pixel) of the original image data, 13 is a differential PCM 
encoding unit (DPCM) for carrying out a differential predict 
encoding per each DC value, 14 is inverse DPCM encoding unit 
for decoding each DC value from the differential PCM encoding, 
15 is a DC image memory for storing a decoded DC image, 16 is 
a DC nest production unit for cutting off the DC nest of a desired 



size from a part of the DC image, and 17 is a DC nest memory 
for storing the DC nest. 

Further, 18 is a subtracter for separating a 
corresponding decoding DC value "DCj" from a target image block 
<Rj> to be encoded, 19 is a differential vector buffer for storing 
a differential vector <dj> which is DC separated, 20 is an 
extracted block buffer for storing a base extraction block <Ui> 
of 4 times 4 pixels which is down-sampled from the DC nest, 21 
is an equilibrator for seeking a block mean value a± of the base 
extraction block <Ui> , 22 is a subtractor for separating the 
block means value ai from the base extraction block <Ui>, 23 is 
an extracted vector buffer for storing the base extraction block 
<Ui> which is separated by the mean value, 24 is an adaptive 
orthogonal transform { AOT ) processing unit for producing an 
orthogonal basis a k <u k '> (k=l~m) to search the DC nest to make 
the differential vector <dj> closer to the allowable error Z, 
where a square norm || dj || 2 of the differential vector is over 
the allowable error Z, 25 is a coefficient transform unit for 
seeking an expanding square coefficient 0 k which is multiplied 
by a non - orthogonal basis vector <u k > (k = l~m) per the produced 
orthogonal basis a k <u k '> (k=l~m) to produce an equivalent 
non - orthogonal basis 0 k <u k > (k=l~m) , and 26 is an encoding unit 
by Huff man coding , run length coding or fixed length coding system 
for the compression encoding of information such as DPCM encoding 
of the DC value or the non - or thogonal basis 0 k <u k > . 

In the DC value production unit 12, the block mean value 
of 4 times 4 pixels is provided in which the first decimal place 
is rounded off or down. In the DPCM 13, where the DC value of 
row J and column T* is shown by the DC J/ I# a predictive value 
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DCj, i' of the DCj.i is provided by the formula, DCj, T ' « (DCj, 
1-1 + DCj-i, i ) / 2, and its predictive error (A DCj, z = DC J( z 
- DCj, i ' ) is linear- quantized by a quantization coefficient Q (Z) 
and is output. The quantization coefficient Q(Z) corresponds 
5 to the allowable error Z and is variable within the range of 
1 to 8 according to the allowable error Z. 

In the DC nest production unit 16 , the DC nest is prepared 
by copying the range of vertical 39 x horizontal 71 from the 
DC image. It is preferred that the DC nest includes more 
10 alternating current components because it is used as a codebook. 
Therefore, it is prepared by copying such the range that the 
sum of absolute values of difference between the DC values 
adjacent to each other in a plurality of the extracted ranges 
become maximum. 

15 In making down - samples of the base extraction block<U i > / 

a vertex per one DC value in vertical and horizontal section 
issetto (p X( p y ) £= [0, 63]x[o, 3 l]and adistanceof its sub - samples 
is set to 4 kinds of (s x , s y ) G { (l, l) , (l, 2) , (2, l) , 
(2, 2) } . Accordingly, the total numbers of the base extraction 

20 blocks<Ui>are N ( = 8192) and are referred by an index counter 
"i" from the AOT 24. Behavior of conventional adaptive 
orthogonal transform processing unit 24 will be explained below . 

Fig. 2 isaflowchartof conventional adaptive orthogonal 
transform processing and Fig. 3 is an image drawing of the 

25 processing. In Fig. 2, it is input in the processing that the 
square norm || dj || 2 of the differential vector is more than Z. 
In step S121, the square norm || dj || 2 of the differential vector 
is set in a resister E. A basis number counter is initialized 
to k = 1 . In step S122, much value ( e.g. 100,000) is set in 
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a minimum value holding resister E ' . In step S123, an index 
counter of the base extraction block<Ui>is initialized to i = 
0. By these steps, the initial address and distance of 
sub-samples in the DC nest are set to (p x , p y ) = (0, 0) and (s x , 
5 s y ) = (1, 1), respectively. 

In step S124, the base extraction vector <ui> is produced 
by separating the block mean value ai from the base extraction 
blocks<Ui>. Since the operation or calculation is carried out 
under the accuracy of integer level, any value of first decimal 
10 place in the block mean value a± is rounded off or down. In step 
S125, the base extraction vector<ui>is subjected to orthogonal 
transform processing to be converted to the orthogonal basis 
vector<u K ' > , if necessary (k > 1). 

Fig. 3 (A) and (B) are image drawings of the orthogonal 
15 transform processing. In Fig. 3 (A) , the first base extraction 
vector<Ui>can be the first basis vector<Ui ' >as it is. 

Then, the second base extraction vector<u 2 >is subjected 
to orthogonal transform processing to be converted to the second 
basis vector<u 2 '>in accordance with the following method. That 
20 is, a shadow of the second base extraction vector<u 2 > projected 
on the first basis vec tor< u x ' > i s repres en ted by the formula ( 1 ) . 
[Numeral 1] 

Accordingly, the second orthogonal vector <u 2 '> is 
25 obtained by subtracting the vector of the projected shadow from 
the second base extraction vector<u 2 >. 
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[Numeral 2] 



(u, 1 U.) u/ 

U!= " : MR (2) 



In Fig. 3 (B), the third base extraction vector <u 3 > is 
5 subjected to orthogonal transform processing to the first basis 
vec tor<Ui ' >and the second basis vector<u 2 '>. 

Fig. 3 is three - dimensionally drawn. The third base 
extraction vector<u 3 >is subjected to orthogonal transform 
processing to the first basis vector <Ui'> to obtain an 
10 intermediate orthogonal vec tor<u 3 ' ' > . 
[Numeral 3] 




Further, the intermediate orthogonal vector<u 3 ' ' >is 
15 subj ected to orthogonal transform processing to the second basis 
vec tor <u 2 ' > to obtain the third basis vector <u 3 '>. 

[Numeral 4] 
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Turning to Fig. 2, in step S126, a scalar coefficient 
<x ± is calculated using the orthogonal vec tor < ui ' > so that a 
5 distance with the differential vector<d k > (at f irs t <dj > ) becomes 
minimum . 

Fig. 3 (C) is an image drawing of the orthogonal transform 
processing. In Fig. 3 (C) , where a differential vector 
represented by<d k >is subjected to approximation, a square norm 

10 thereof (ei = ll<d k >— a L < u± ' > || 2 ) is minimum when the product 
of the orthogonal vec tor<ui ' > and the scalar coefficient a ± is 
diagonal with the differential vector {<d k >— a i <ui' >} as shown 
in Fig. 3 (C) (inner product = 0). Accordingly, the scalar 
coefficient <x ± is obtained by the formula (5). 

15 [Numeral 5] 



It is shown in the drawing that the differential 
vec tor < d k > (k= 0 ) is subjected to approximation to other first 
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(5-1) 
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base extraction vector<Uj'>. The first base extraction 
vec tor<Uj ' > is shown by the image drawing because it can take 
optional directions. 

Turning to Fig. 2, in step S127, a square norm (ei) of 
5 error vec tor is obtained by the formula (6) after the differential 
vector<d k > (k = 0) is subjected to approximation to the base 
extraction vector ac ±<\ij ' > . 

[Numeral 6] 



«. =K -«,u,f 

= Klf - 2«. •»,') + a, ; |u,f 




In step S128 of Fig. 2, it is judged whether e± is less 
than E' or not. If ei is less than E', content of E' is renewal 
in step S129 and the information regarding a ± , < u± 1 > , < m > , etc. 
15 at the time is held in an arrangement [a k ] , [u k ' ] , [u k ] , etc. 
If ei is not less than E' , the processing in step S129 is skipped. 

In step S130, one (1) is added to the counter i, and in 
step S131, it is judged whether i is not less than N (= 8192) 
or not. If i is less than N , turning to step 124 and the same 
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processing is carried out with respect to next base extraction 
vec tor<ui > . 

The processing is repeated and when it is judged in step 
SI 31 that iisnotless than N, all base extraction vec tor s < ui > have 
been completely tried. At the time, the register E' holds the 
minimum square norm e A . 

It is judged in step S132 whether E' is not more than 
Z or not. If E' is more than Z, it is treated as E = E ' in step 
S133. That is, the square norm of the differential vector is 
renewal. In step S134, one (1) is added to the counter k, turning 
tostepS122. If E' is not more than Z , thisprocessing is skipped. 
Thus, the orthogonal basis a k <u k '>(k = 1 ~ m) to approximate 
the difference of the first differential vector<dj>to the 
allowable error Z is obtained. 

However, the block mean value ai of the base extraction 
block<Ui>has been rounded off or down in the conventional methods 
and therefore, improvement of image quality is limited. Why 
the conventional methods are inconvenient will be explained 
according to Fig. 4. 

Fig. 4 is an image drawing of mean value separation 
processing. A relationship of base extraction 

block<Ui> (vertical axis) with the pixel value of certain row 
(horizontal axis) is shown in Fig. 4 (a) . An actual pixel value 
is a block mean value of 16 pixels, but the block mean value 
of 4 pixels will be used to simplify the explanation herein. 
In Fig. 14 (a), each pixel value is 5, 2, 4, and 3 and its mean 
value ai is 3.5. when the first decimal place is round down, 
the block mean value a A of the base extraction block<ui>is 0.5 
as shown in Fig. 4(b). In Fig. 4 (c), if the basis vector $ 



k <u k >is added to the DC value DCj of the decoded block, the DC 
component (ai =0.5) is overlapped on the target block<Rj>. In 
case that the number of basis is plural, the DC value is overlapped 
on the DCj by various values in the range of 0<ai<Cl, and as 
a result, certain noise is overlapped per each block in the decoded 
image, whereby image quality is not improved. This disadvantage 
also occurs in case that the first decimal place is rounded off 
or up . 

According to the conventional AOT processing, much 
operations and much time are required, because all of the base 
extraction vectors <ui >mus t be subj ected to orthogonal processing 
to the preceding base vec tors < u k ' > . 

SUMMARY OF THE INVENTION 

It is therefore an object of the invention to provide 
an image encoding/decoding method, which provides high image 
quality at high speed, an apparatus thereof and a recording medium 
in which such program therefor is recorded. 

The above object of the invention can be solved by the 
construction, for example, as shown in Fig. 5. That is, the 
image encoding method of the invention (1) comprises producing 
a DC image composed of each block mean value by dividing an image 
data per B pixel into a block, making a part of said DC image 
a DC nest, and where the differential vec tor < dj > which is obtained 
by separating the DC value DCj from the pixel block to be encoded 
is over an allowable value Z, calculating one or more orthogonal 
basis ( e.g. a k <v k >) , to which the differential vec tor < dj > i s 
approximated, by the adaptive orthogonal transform (AOT) using 
the DC nest, wherein the lowest n (n = log 2 B) bits of the DC 



pixel in each sample being set to 0, where the base extraction 
block is down - sampled from the DC nest and the block mean value 
ai of it is calculated using the samples. 

Accordingly, any fraction less than 1 does not occurs 
in the block mean value ai and the block mean value a± with integer 
level precision is obtained at high speed. 

In a preferred embodiment of the invention (1) that is 
the invention (2) , the lowest n bits of the DC pixel is set 
to 0 or is masked, where the DC nest is produced from the DC 
image . 

Accordingly, the DC nest, of which the lowest n bits of 
the DC pixel is set to 0 or is masked, is efficiently obtained 
by one processing. 

In a preferred embodiment of the invention (1) or (2) 
that is the invent ion (3) , a base extraction vector<Ui>is produced 
to which the differential vector< dj >approxima tes by separating 
the block mean value ai from the base extraction block<Ui>in which 
the lowest n bits of the DC pixel is set to 0. 

According to the invention (3), the sum (the block mean 
value) of all elements in such base extraction vectors<Ui>is 
always 0 and the DC component is completely separated . Therefore , 
even if the base vector s <u k >are piled up on each other in the 
decoding side, unnecessary DC component (noise) does not cause. 
The image quality in the HVQ system is more improved by the 
invention ( 3 ) . 

In a preferred embodiment of the invention (3) that is 
the invention (4 ) , optional elements (e.g. u i6 ) ofbase extraction 
vectors < Ui > are replaced by linear bond of the remainder elements 
and the inner product of the base extraction vec tors<ui >and the 



other optional vectors <w>are calculated by the formula. 



<W ' Ui>= (Wi — W 16 ) Ui + (W 2 — W 16 ) U 2 + • • • + (W15 — W 16 ) Uis 

In the invention (4) , the sum of all elements in the base 
extraction vec tors < u± > i s always 0 and hence, the optional 
elements (e.g. u 16 ) are represented by the linear bond of the 
remainder elements. Accordingly, the inner product 

calcula tion< w • Ui>with the other optional vectors (w) can be 
expanded to the product- sum calculation as shown by the above 
formula, whereby a single round of such complicated calculation 
can be omitted. Since much inner product calculation of the 
vectors is conducted in the image encoding method according to 
the HVQ system, such single round omission of the calculation 
contributes to high speed encoding processing. 

In a preferred embodiment of the invention (3) or (4) 
that is the invention (5), a first basis is searched so that 
hi may be maximum in the following formula, 

hi = <d ■ Ui> 2 / II Ui || 2 
wherein<d>is the differential vectors and<ui>is the base 
extraction vectors. 

According to the invention (5) , such condition that square norm 
|| <d> — < a i Ui> || 2 of the difference with the differential 
vectors<d>is minimum can be searched by the above simple 
calculation. Hence, the AOT processing can be carried out at 
high speed. 

In the invention (6) , a second basis is searched so that 
hi may be maximum in the following formula, 

hi - { <d • Ui> - ( <d ■ ux> <u x • Ui> / || ui II 2 ) 2 



/ { || ui II 2 - ( <u x • Ui > ) / || Ul || 2 } 
wherein <d> is the differential vectors, <Ui>is the base 
extraction vectors corresponding to the first basis, and <u ± > 
is the base extraction vectors for searching the second basis 
5 in the invention (3) or (4) . 

According to the invention (6), the AOT processing can 
be done more efficiently and at higher speed in addition to the 
advantages of the invention (5) , because the calculation result 
which has been obtained in the first basis search can be used 
10 with respect to <d ■ u x >and || Ui || of the numerator, and || ui || 2 and 
|| ui || of the denominator. 

In a preferred embodiment of the invention (3) or (4) 
that is the invention (7), a third basis is searched so that 
hi may be maximum in the following formula, 
15 hi = ( <d * Ui> — <d • v x > <vi • Ui> — <d • v 2 > <v 2 • Ui> ) 2 

/ { II Ui || 2 - <V X ■ Ui> 2 - <V 2 • Ui> 2 } 

wherein <d> is the differential vectors, <Vi> is the first 
orthonormal base vectors, <v 2 > is the second orthonormal base 
vectors, and<Ui>is the base extraction vectors for searching 

20 the third basis. 

According to the invention (7), the AOT processing can 
be done more efficiently and at higher speed in addition to the 
advantages of the invention (5) and (6) , because the calculation 
result which has been obtained in the first and second basis 

25 search can be used with respect to (<d ■ Ui> — <d * vi><vi • ui>) of 
the numerator, and ( || ui || 2 -<vi * u ± > 2 ) of the denominator. 

In a preferred embodiment of the invention (6) or (7) 
that is the invention (8) , the base extraction vec tor s < u ± > whi ch 
match with search conditions are subjected to orthogonal 
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transform with one or more preceding orthonormal basis. 

That is, one orthonormal processing per each base 
extraction vector<Ui>, which is adopted as the basis after the 
search termination at each stage is carried out, whereby the 
AOT processing can be done more efficiently and at higher speed. 

In the image encoding method of the invention (9) , the 
norm of each scalar expansion coef f ici ent 0 x ~ ft m is rearranged 
in decreasing order, a difference (including 0) between norms 
adjacent to each other is calculated, and Huffman coding is 
applied to the obtained difference. In the method, the basis 
is represented by/9 kL <u Jt >, wherein k = 1~ m. 

In general , the norm of each scalar expansion coefficient 
&i ~&m can take various value. When the value is rearranged 
in ascending or descending order and the difference (including 
0) between norms adjacent to each other is calculated, each 
difference is often similar to or same as each other. The more 
encoding compression is possible by applying the Huffman coding 
to the difference value. 

In the image encoding method of the invention (10) , image 
data<Rj>of coding obj ective block is encoded instead of the coding 
of the basis, where the basis is more than certain number. 
Accordingly, the decoded image quality is improved. In 
practical, it does not affect the coding compression ratio because 
such situation is little. 

The above object of the invention can be resolved by the 
construction, for example, as shown in Fig. 14. That is, the 
image decoding method of the invention (11) comprises reproducing 
a DC image corresponding to each block mean value per B pixel 
from encoding data with respect to the HVQ system, making a part 



of said DC image a DC nest, reproducing image data<Rj>of target 
block by synthesizing, to DC value DCj of target block, one or 
more basis vectors /3 k <u k > which is selected from DC nests based 
on the encoding data, and the lowest n (n = log 2 B) bits of the 
5 DC pixel in each sample is set to 0, where the selected block 
is down- sampled from the DC nest and the block mean value of 
it is calculated using the samples. 

Accordingly, any fraction less than 1 does not occurs 
in the block mean value and the block mean value with integer 

10 level precision is obtained at high speed. 

According to the image decoding method in the invention 
(12), where the decoded basis is information with respect to 
/3 k <u k > (k « 1- m) , the lowest n (n = log 2 B) bits of the DC pixel 
per each selected block (U k ) to be read out from the DC nest 

15 are set to 0, product-sum calculation of bas i s 0 k < u k > ( k - 1- m) 
is carried out, and the calculated result is divided by the number 
B of block pixels. 

In the invention (12) , the lowest n bits of each selected 
block (U k ) are set to 0, and hence, even if these are accumulated 

20 and added, the addition result becomes multiple of integer of 
the block size B (e.g. 16) . An expansion coefficient 0 k is an 
integer precision. Accordingly, if the cumulative addition 
result is divided by the number B of the block pixels, block 
mean value Aj is efficiently obtained by one processing. 

25 Therefore, such calculation that the basis vectors /? k <u k > (k 
= 1- m) are overlapped can be effectively carried out. 

In a preferred embodiment of the invention (11) or (12) 
that is the invention (13), the lowest n bits of each DC pixel 
is set to 0, where DC nests are produced from the DC image, whereby 
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processing is effectively carried out. 

The image encoding apparatus of the invention (14) 
comprises producing a DC image composed of each block mean value 
by dividing an image data per B pixel into a block, making a 
5 part of said DC image a DC nest, and where a differential 
vec tor< dj >which is obtained by separating the DC value DCj from 
the pixel block to be encoded is over an allowable value Z, 
calculating one or more orthogonal bas is (e.g. a k <v k >), to which 
the differential vector<dj>is approximated, by the adaptive 

10 orthogonal transform (ACT) using the DC nest, and providing a 
memory 17 to store the DC nest in which the lowest n (n = log 2 
B) bits of the DC pixel are set to 0. 

The image decoding apparatus of the invention (15) 
comprises reproducing a DC image corresponding to each block 

15 mean value per B pixel from encoding data with respect to the 
HVQ system, making a part of said DC image a DC nest, reproducing 
image data<Rj>of target block by synthesizing, to the DC value 
DCj of target block, one or more basis vectors & k <u k >which is 
selected from DC nests based on the encoding data, and providing 

20 a memory 49 to store the DC nest in which the lowest n (n = log 2 
B) bits of the DC pixel are set to 0. 

The recording medium of the invention (16) comprises a 
computer readable recording medium storing a program to make 
a computer to implement the processing described in one of the 

25 invention (1) to (13) . 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a conventional image 

encoder ; 
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Fig 


. 2 is a flow chart of a conventional adaptive 


orthogonal 


transform process ing ; 


Fig 


. 3 is an image drawing of the conventional adaptive 


orthogonal 


trans form processing ; 


Fig 


. 4 is an image drawing of a conventional mean value 


separation 


processing; 


Fig 


. 5 is an explanatory drawing of the principle of the 


invention ; 




Fig 


. 6 is a block diagram showing an image encoder, which 



is an embodiment of the invention; 

Fig. 7 is a flow chart showing a main image encoding 
processing which is an embodiment of the invention; 

Fig. 8 is a flow chart (1) showing an adaptive orthogonal 
transform processing which is an embodiment of the invention; 

Fig. 9 is a flow chart (2) showing an adaptive orthogonal 
transform processing which is an embodiment of the invention; 

Fig. 10 is a flow chart (3) showing an adaptive orthogonal 
transform processing which is an embodiment of the invention; 





Fig. 11 is 


an 


explanatory drawing 


(1) 


of a DC nest , 


which 


is 


an embodiment 


of 


the invention; 










Fig. 12 is 


an 


explanatory drawing 


(2) 


of a DC nest, 


which 


is 


an embodiment 


of 


the invention; 









Fig. 13 is an image drawing of a compression encoding 
processing of the expansion coefficient; 

Fig. 14 is a block diagram showing an image decoder, which 
is an embodiment of the invention; 

Fig. 15 is a flow chart showing an image decoding 
processing which is an embodiment of the invention; and 

Fig. 16 is an image drawing of an alternating current 



component prediction, which is an embodiment of the invention. 



DETAILED DESCRIPTION OF THE INVENTION 

Referring to the drawings, suitable embodiments of the 
invention will be explained in detail. The same sign indicates 
same or corresponding part through whole drawings. 

In Fig. 6 which is a block diagram showing an embodiment 
of image encoding apparatus in the invention, 31 is a DC nest 
production unit which produces the DC nest from a decoding DC 
image according to the invention, 17 is a DC nest memory which 
stores the produced DC nest, 32 is an adaptive orthogonal 
transform (AOT) processing unit which effectively implements 
AOT processing at high speed, 33 is a coefficient transform unit, 
and 34 is an encoding unit which can make an expanding coefficient 
$ k higher compression. The other construction is same as in 
Fig. 1. The feature of each unit will be apparent from the 
following explanation of behavior. 

In Fig. 7, which is a flow chart showing a main image 
encoding processing, which is an embodiment of the invention, 
an original image data is input in a original image memory 11 
atstepSl. Forexample, an ob j ec tive image of R . G . B . is converted 
to an image of Y.U.V., which is input in the memory 11. Y is 
a brightness data, U and V are color difference data. U and 
V are down-sampled using a brightness mean of 2 pixels in a 
horizontal direction. As an example, the brightness data Y is 
composed of vertical 960 X horizontal 1280 pixels and, for 
example, 8 bits are allotted to each pixel. The processing of 
the brightness data Y will be mainly explained in the following 
but U and V are similarly processed. 



A block mean (DC) value of every 4 X 4 pixels with respect 
to all image data is calculated at step S2 . The first decimal 
place is round off at the time. All DC values are encoded by 
conventional two-dimensional DPCM method, etc. and are output 
at step S3. At step S4, all DPCM outputs are decoded by IDPCM 
method to reproduce the DC images, which are stored in a DC image 
memory 15. This is done to equalize AOT processing conditions 
in the encoding side with that in the decoding side. At step 
S5, the DC nest is reproduced from the DC images in the DC nest 
production unit 31, which is stored in the DC nest memory 17. 
A range from which the DC nest is cut can be selected by the 
same manner as conventional one. 

In Fig. 11 (a), the lowest 4 bits of each DC pixel DCj 
cut from the DC image memory 15 are masked (are set to 0) which 
are stored in a nest pixel Nj of the DC nest memory 17. The 
lowest 4 bits are in relation with 2 4 = B (B = block size 16) 
or 4 = log 2 B. As such result that the lowest 4 bits are masked, 
the sum of base extraction block<Ui>is always multiple of integer 
and a block mean value a ± which is 1/16 of the sum is always 
an integer. Accordingly, the base extraction vectors<ui>which 
are obtained by separating the block mean value ai from the base 
extraction block<Ui>are always 0. 

In Fig 11 (a) and (b) , graphs of concrete values are 
shown as example , in which mean of 4 pixels is used for simpli f ying 
the explanation. In Fig. 11 (c), even if a plurality of basis 
vectors^ <u k >are cumulatively added to the DC pixel DCj of a 
decoding block<Rj>, a noise is not overlapped as usual because 
the block mean value of each basis vectors ^ k <u k > is always 0, 
whereby image quality can be much improved. 



The examples of the value in Fig. 11 are shown in Fig. 

12 (a) . The sum of the DC pixels A to D is 251 and its mean 
is 251/4 = 62.75 (non - integer ) . The lowest 4 bits are masked 
when the DC pixels A to D are transmitted to the nest pixels 
A to D, whereby the sum of the nest pixels A to D is 224 and 
its mean value AV is 224/4 = 56 (integer) . Each element a to 
d of the base extraction vectors <ui> which is obtained by 
separating the mean value 56 of the nest pixels from the nest 
pixels becomes 24 , -24, 8 and - 8, respectively. The sum of these 
elements is 0 (complete mean value separation) . 

The same value as in Fig. 12 (a) is shown in Fig. 12 (b) , 
except that the DC pixels A to D are copied into the nest pixels 
A to D and the lowest 4 bits are masked from the sum of the nest 
pixels A to D. According to the method, the sum is the multiple 
of 16 and the block mean value is 60 (integer) . However, according 
to the method, each element a to d of the base extraction 
vectors<ui>which is obtained by separating the mean value 60 
of the nest pixels from the nest pixels A to D becomes 33, -25, 

13 and -10, respectively. The sum of these elements is not 0 
(complete mean value separation) . 

As shown in Fig. 12 (b) , after a part of the DC images 
is copied into the nest pixels A to D, the lowest 4 bits may 
be masked from each pixel when the base extraction block<Ui>is 
down- sampled from the DC nest. 

Turning to Fig . 7 , each index counter j , J to the original 
image memory 11 and the DC image memory 15 is initialized to 
0 at step S6, wherein j indicates an index counter of the target 
block<Rj >which is encoding object, and J indicates an index 
counter of the DC pixel. At step S7, the differential 



vector<dj >is obtained by separating a corresponding decoding 
DC value DC f from the target block<Rj>. At step S8, it is judged 
whether the square norm || dj || 2 of the differential vector is 
more than the allowable error Z or not. In case that || dj || 2 is 
5 not more than Z, 0 is output as the number of the basis at step 
S17 . In this case, the target block<Rj >is decoded by alternating 
current component prediction method as described hereinafter. 
In case that || dj || 2 is more than Z, the adaptive orthogonal 
transform (AOT) processing method as described hereinafter is 

10 carried out at step S9. 

At step S10, it is judged whether the number of the basis 
k produced by the adaptive orthogonal transform is more than 
4 or not. According to the actual measurement, statistic result 
of k - 1 to 3 has been obtained in most cases. Therefore, in 

15 case that k is more than 4, "5" is code-output as the number 
of the basis at step S18 and each pixel value of the target 
block<Rj>is output. In case that k is not more than 4, conversion 
to expanding coefficient /3 k is carried out as described 
hereinafter at step Sll. At step S12, the basis number m, the 

20 expanding coefficient 0 k and the index information i of 
non - orthogonal basis vec tor<Ui >each is code-output at step S12. 

At step S13, "1" is added to the counters j and J, 
respectively. In the step, an addition of 1 to the counter j 
means renewal of one pixel block. Itis judged at step S14 whether 

25 j is not less than M (the number of all image blocks) or not. 
In case that j is less than M, turning to step S7 and same encoding 
processing is repeated with respect to a next target block<Rj>, 
followed by same steps. It is judged at step S14 that j is not 
less than M, then encoding processing, for example, by Huffman 
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method is carried out at step S15 as described hereinafter. Thus , 
encoding processing of one pixel is terminated. 

In Figs. 8 to 10, each of which is a flow chart (1) , (2) 
or (3) of the adaptive orthogonal transform processing, it is 
shown that the minimum necessary number of orthogonal basis a 
k <v k > (k=l~m) is effectively obtained at high speed. In the 
following explanation, the initial differential 

vector < dj >obtained at the step S7 is represented by <d> and the 
differential vector to be renewed later is represented by <d^> 
(k=l~m) . 

A search processing of first basis is shown in Fig. 8. 
Before explanation of the processing, an idea on calculation 
for high speed processing will be explained. That is, the first 
basis is usually obtained as base extraction vector<Uj>, which 
makes a square norm ei of the difference between the first basis 
and a differential vector < d>minimum, and is represented by the 
formula ( 7 ) . 
[Numeral 7] 




(7) 



The first item || d || 2 of the right side in the formula 
which is more than 0 is independent of an extracted basis 



and hence , <u± > that makes the second item of the right side in 
the formula (7) maximum can be the first basis. The second item 
hi of the right side is represented by the formula (8). 
[Numeral 8] 

A '-LjF- (8) 



A processing for searching and judging the first basis 
a x <v k >which makes hi maximum is explained. At step S22, the 
fifteen dimensional vector<d'>is obtained by subtracting the 
sixteenth component of <d>from the remaining components as a 
10 preprocessing to inner product calcula tion< d ■ ui >as described 
hereinafter. At step S22, the inner product<d' * u t >of h± 
numerator is obtained with respect to i = 0 ~ (N— 1) and is stored 
in an arrangement [Pi] {i - 0 ~ (N-l)} . 

More concretely, <ui>is sixteen dimensional vector, but 
15 its sixteenth component u 16 can be represented by linear bond 
of the remaining fifteen components because the block mean value 
(sum of all elements) is 0. 
[Numeral 9] 

M, +//, +"-+l/ |t) = 0 

W I6 =-(», +U 2 +— +« |3 ) ( 9) 

20 Accordingly, the inner product<d • ui>of h± numerator can 

be calculated from<d' • u± > equi val ent thereto, whereby one 
product /sum calculation can be omitted which corresponds to 8192 
calculations with respect to total of i. 
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[Numeral 10] 

At step S23, the square norm || u A || 2 of h ± denominator is 
obtained with respect to i = 0 ~ (N~ 1) and is stored in an 
5 arrangement {i = 0 - (N~ 1)} . 

[Numeral 11] 

II Ui II 2 - ui 2 + u 2 2 + — + u 16 2 (11) 

10 The arrangement [Li] is repeatedly used. At step S 24, 

a register E ■ 0 storing a maximum value of h i# an index counter 
i = 0 of the base extraction vector<Ui>and a basis number counter 
k=l are initialized, respectively. 

At step S25, a value for hi = Pi 2 / Li is calculated. Step 

15 S 26, it is judged whether hi is more than E or not. In case 
that hi is more than E, E is renewed by hi at step S27 and i is 
held in an arrangement [i*] (k=l) . In case that hi is not more 
than E, the processing at Step S 27 is skipped. 

At step S28, 1 is added to i and at step S29, it is judged 

20 whether i is not less than N (total extraction numbers) or not. 
In case that i is less than N, turning to step S25 and maximum 
value search processing is carried out with respect to next hi 
similar to above. 

The same processing is repeated and the search of all 

25 nest blocks is terminated when i is not less than N. At the 
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time, the index value i of the first basis vec tor < Ui >whi ch makes 
hi maximum is held in an arrangement [l k ] . 

At step S30, the first basis vector<Ui>is normalized to 
be a normalized basis vec tor < v A >which is stored in an arrangement 
5 [v k ] (k = l) . And, a scalar coefficient a x (projection shadow 
of <d>on< vi>is calculated and is stored in an arrangement [a k ] 
(k=l). 

At step S31, the differential vector<d>is approximated 
to the first basis and is renewed by the differential vector<di> = 

10 <d>— a x <Vi>. At step S32, a square norm e= || Ui || 2 of new 
differential vector is calculated and at step S33, it is judged 
whether e is not more than Z or not. In case that e is not more 
than Z, the AOT processing is terminated at the step. In case 
that e is more than Z, the search processing of the second basis 

15 is carried out. 

A search processing of the second basis is shown in Fig. 
9. Before explanation of the processing, an idea on efficient 
calculation will be explained. That is, the second basis is 
usually obtained as orthogonal vec tor< Uj ' >which makes a square 

20 norm ei of the difference between the second basis and a 
differential vector<di> minimum, and is represented by the 
formula ( 12 ) . 
[Numeral 12] 



25 




(12) 



The orthogonal vector<ui' >is obtained by orthogonal 



transform of the second base extraction vector<ui>to the first 
normalized basis vector<Vi>. 

[Numeral 13] 



(12) which is more than 0 is independent of an extracted basis 
and hence ,< ui '> that makes the second item of the right side in 
the formula (12) maximum can be the second basis. The second 
item hi of the right side is represented by the formula (14) . 

[Numeral 14] 




(13) 



The first item II d || 2 



of the right side in the formula 



hf 



(14) 



According to the formula (14) , hi can be calculated but 
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the denominator of the formula (14) may be transformed in order 
to effectively utilize the calculation result in Fig. 8. That 
is, if the orthogonal vec tor<ui ' >of the hi numerator is 
represented by the base extraction vector<ui>, the hi numerator 
5 can be represented by the formula (15). 
[Numeral 15] 



10 (15) is represented by the first differential vector<d>, the 
hi numerator can be represented by the formula (16). 

[Numeral 16] 



Accordingly, the calculation result < d*Ui> which is 
obtained in the search of the first basis can be used for 
calculation of the hi numerator. Also, when the hi denominator 
20 is transformed, it can be represented by the formula (17). 
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Further, if the differential vector<di>of the formula 



15 





[Numeral 17] 



iKir=iK-(-.«v,>v,f 

= ||u,f -2(u,.v 1 ) 2 + ( u ,.v,) J ||v,f 

=kir-(»,.v,> j . - - 

\ M J 

5 

Accordingly, The calculation result || ui || 2 , || u x || which 
is obtained in the first basis search canbe used in the calculation 
of the hi numerator. When h± is placed in the formula (14), it 
can be represented by the formula (18-1) and f inal ly by the formula 
10 (18 - 2) . 



(17) 



[Numeral 18] 



h = 



_ V 



u, 



f 



p P k (u,«u t ) 



L. - 



(181) 



(18-2) 



28 



A calculating result of the arrangement [Pi] , [Li] 
can be used for Pi = <di ■ u±> , Li = II u x || 2 , respectively and the 
preceding result can be used for P k = P ± =<d • Ui>, V^L k ^~ 
Li = II Ui || . Accordingly, it is in a part of < u k • u± > = < u x • 
5 ui >that a calculation is newly required. 

Based on the background as above, a search of the second 
basis is carried out by the following calculation. That is, 
at step S41, P x =<d ■ Ui>and L x = || u x || 2 are held as k = 1 . The 
result obtained in steps S22 and S23 can be used. The numeral 
10 "1" of Pi means the first basis<u 1 >in the index counter i and 
is held in an arrangement [l k ] at step S27. At step S42, a 
calculation is carried out by the formula (19) and a result is 
stored in a register V , k . 

15 [Numeral 19] 
1 

7 = 7/7 * = (19) 

At step S43, the fifteen dimensional vector<Wi>is 
obtained by subtracting the sixteenth component of <ui>from the 

20 remaining components as the preprocessing of inner product 
calculation< u x ■ u A >as described below. At step S44, an inner 
product < w k • Ui >is calculated with respect to i = 0 - (N-l) 
and is stored in an arrangement [q±] . At step S45, ( P ± — K 
Qi ) is calculated with respect to i = 0 - (N-l) and is stored 

25 in and written in over an arrangement [p d ] . The calculation 
result at step S45 is stored in (written in over) an arrangement 
[Pi] , whereby contents of the arrangement [Pi] are gradually 
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renewed on the past calculation result. Further, at step S46, 
(Li — Qi 2 ) is calculated with respect to i = 0 ~ (N-l) and is 
stored in and written in over an arrangement [Li] . Li in the 
right side is a result of the calculation at step S23 . The 
calculation result at step S46 is stored in and written in over 
an arrangement [Li]at step S2 3 , whereby contents of the arrangement 
[Li] are gradually renewed on the past calculation result . The 
repeated calculation of hi is finally represented by the formula 
(20) . 

[Numeral 20] 



2 - — (20) 



At step S24, a register E = 0 holding a maximum value 
15 of hi and an index counter i = 0 of the base extraction vector<Ui>are 
initialized, respectively and "1" is added to a basis number 
counter k to be k = 2 . 

At step S48, hi =Pi 2 / Li is calculated. At step S49, 
it is judged whether hi is more than E or not In case that hi 
20 is more than E, E is renewed by hi at step S50 and i is stored 
in an arrangement [l k ] (k = 2) . In case that hi is not more than 
E, the processing at step S 50 is skipped. 

At step S51, "1" is added to i and at step S52, it is 
judged whether i is not less than N or not. In case that i is 
25 less than N, turning to step S 42 and the maximum value search 
processing is carried out with respect to subsequent hi . When 
the same procedure was proceeded and i is not less than N, the 
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search of the all nest blocks are terminated. At the time, the 
index value of the second basis vector<Ui>to make hi maximum is 
held in an arrangement [l k ] (k-2) . 

At step S53, the second basis vector<u 2 >is subjected to 
5 orthonormal with<v x >to be a normalized basis vec tor< v 2 >which is 
stored in an arrangement [v k ] (k = 2). A scalar coefficient a 2 
which is a shadow of <di>pro j ected to<v 2 >is calculated and is 
stored in an arrangement [a*] (k=2) . The orthonormalization 
of the basis vec t or < u 2 > and the calculation of the scalar 

10 coefficient a 2 are carried out at one time with respect to the 
above search result, whereby the AOT process ing is much simpli f ied 
at high speed. 

At step S54, the differential vector<di>is closed to the 
second basis and is renewed by the differential vector<d 2 >- <d x > 

15 — a 2 <v 2 >. At step S55, a square norm e= || u 2 || 2 of new 
differential vector is calculated and at step S56, it is judged 
whether e is not more than Z or not. In case that e is not more 
than Z, the AOT processing is terminated at the step. In case 
that e is more than Z, the search processing of the third basis 

20 is carried out. 

A search processing of the second basis is shown in Fig. 
6. Before explanation of the processing, an idea on efficient 
calculation will be explained. That is, the third basis is 
usually obtained as orthogonal vector<Uj ' >which makes a square 

25 norm e± of the difference between the second basis and a 
differential vec tor < d 2 >minimum, and is represented by the 
formula (21 ) . 
[Numeral 21] 
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II I If 

■kf 




(21) 



The 



orthogonal 



vector<ui ' > is 



obtained 



by 



orthogonalization of the third base extraction vector<Ui>to the 
first normalized basis vec tor < Vi > and the second normalized basis 
vec tor< v 2 > . 

[Numeral 22] 



(21) which is more than 0 is independent of an extracted basis 
and hence, <ui' > that makes the second item of the right side in 
the formula (21) maximum becomes the third basis. The second 
item hi of the right side is represented by the formula (23) . 
[Numeral 23] 




(22) 



The first item || d 2 II 2 



of the right side in the formula 




(23) 
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If the orthogonal vec tor<u A ' >of the hi numerator is 
represented by the base extraction vector<ui>, the hi numerator 
can be represented by the formula (24) . 



[Numeral 24] 



(d 2 .»,•)' = (d 2 .(„, -(u, •v,)v 1 -(„, •v 2 )v : )) 2 

= • v,>(u ( ♦ Vl )-{d 2 .v 2 )( Ul .y 2 )f 

= (<* 2 -u,) 2 v(d 2 . V| ) = 0 (d 2 .v 2 ) = 0 (24) 

Further, if the differential vector<d 2 >of the formula 
(24) is represented by the first differential vector<d>, the 
hi numerator can be represented by the formula (25) . 

[Numeral 25] 

(d 2 .u l ) 2 =((d-(d.v 1 )v 1 -(d*y : )v 2 )*u,) 3 

= ((d • u, ) - (d . v, )(v, . U| ) - (d • v 2 )(v : • „,)) 2 (25) 

l N ,; IK! hi ~ M "1KTJ 

Also, when the hi denominator is transformed, it can be 
represented by the formula (26) . 

[Numeral 26] 

IKf =1", -{«, .v,)v, -<„, .v ; )v ; |||u, -(„, .v,)v, -(», .v 3 )v 3 | 

= lklf-(». •»,)'.(., V; ) : (26) 
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When hi is placed in the formula (23), i t can be represented 
by the formula (27) . 



[Numeral 27] 

hj _ ((«» » ) ~ <d • v, )(v, « u, ) - (d . v ; )(y 3 . M< )f 
hf -(".•v,)"-(u 1 .v J ) J 

The second item of numerator and denominator in the 
formula (27) has been already calculated and is represented by 
the formula (28) . 



iP=(d.u ( )-(d.v,)(v | . U| > (28-1) 
=kir->,*v,)" (28-2) 



Accordingly, hi is represented by the formula (29) in 
the same manner as in the formula (18-2), 



[Numeral 29] 




The formula (29) is same form as the formula (18-2) except 
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that the inner product <u k • ui>is changed to <v k • Ui>. 
Accordingly, each basis hereinafter can be effectively obtained 
by repeating the same operation as in Fig. 5. 

Based on the above processing, search of the third and 
following basis is calculated as follows. That is, P 2 ^di • 
u 2 >and L 2 = II u 2 II 2 are hold by k = 2 at stet S61 . At step S6 2 , 
calculation is carried out according to the formula (30) and 
a result is stored in the registers 7] andA: . 



obtained by subtracting the sixteenth component of <v 2 >from the 
remaining components as the preprocessing of inner product 
calculation< v 2 ■ ui >as described below. Since each component 
of <v 2 >is not an integer, it is necessary that an inner product 
is calculated in the form of real number. In order to avoid 
the calculation in the form of real number, each component 
of < v 2 > (i . e . <w 2 > ) is multiplied by a constant "a" to make it an 
integer, in advance. 

At step S 64, an inner product< w 2 • u± > 7] /a is calculated 
with respect to i = 0 ~ (N-l) and is stored in (written in over) 
an arrangement [Qi] . At the time, each calculation result is 
divided by the constant a to put the position of a figure to 
the former position. 

At step S 65, ( Pi — K Qi ) is calculated with respect 
to i= 0 - (N-l) and is stored in (written in over) an arrangement 
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[Numeral 30] 



1 





(30) 



At step S63, the fifteen dimensional vector<w 2 >is 



[Pi] . At step S 46, (Li — Qi 2 ) is calculated with respect to 

i = 0 - (N-l) and is stored in (written in over) an arrangement 

[Li] . The calculation of the formula (29) is represented by 
the formula (31) . 

[Numeral 31] 

hi AP.-«Q.Y ,£ ■" 

L,-Q, 2 A (31) 



At step S 67, a register E = 0 holding a maximum value 
10 of hi and an index counter i 8 Oof the base extraction vector<Ui>are 
initialized, respectively and "1" is added to a basis number 
counter k to be k=3 . 

At step S68, hi =Pi 2 / L ± is calculated. At step S69, 
it is judged whether hi is more than E or not. In case that hi 
15 is more than E, E is renewed by h ± at step S70 and i is held 
in an arrangement [l k ] (k = 3) . In case that hi is not more than 
E, the processing at step S70 is skipped. 1 
At step S71, "1" is added to i and at step S72, it is 
judged whether i is not less than N or not. In case that i is 
20 less than N , turning to step S68 and the maximum value search 
processing is carried out with respect to subsequent h ± . When 
the same procedure was proceeded and i is not less than N, the 
search of the all nest blocks are terminated. At the time, the 
index value of the third basis vector<u 3 >to make hi maximum is 
25 held in an arrangement [l k ] (k=3). 

At step S73, the third basis vector<u 3 >is subjected to 
orthonormal transform wi th< vi > and< v 2 > to be a normalized basis 
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vector <v 3 >which is stored in an arrangement tv k ] . A scalar 
coefficient ol 3 which is a shadow of < d 2 >pr o j ec ted to<v 3 >is 
calculated and is stored in an arrangement [A k ] . 

At step S74, the differential vector<d 2 >is approximated 
to the third basis and is renewed by the differential vector<d 3 >= 
<d 2 > — oc 2 <v 3 >. At step S75, a square norm e= || d 3 || 2 of new 
differential vector is calculated and at step S76, it is judged 
whether e is not more than Z or not. In case that e is not more 
than Z, the AOT processing is terminated at the step. In case 
that e is more than Z, turning to the step S61 and the preprocessing 
and search processing of the fourth and following basis are 
carried out. It isp referred that the processing to judge whether 
k is not less than 4 or not is provided (not shown) after the 
step S76, whereby the AOT processing can be skipped in case that 
k is not less than 4 . 

The AOT processing can be much simplified can be carried 
out at high speed by the above processing or operation. The 
actual calculation time is reduced to 1/3 to 1/10 in comparison 
with conventional methods. 

Referring to Fig. 6, a group of a k <v k > (k=l~m) is obtained 
from AOT 32 and the differential vec tor< dj > is approximated wi thin 
the allowable error Z by the linear bond. 

Further, in the coefficient transform unit 33, the 
expansion coefficient 0 k is obtained to transform the group of 
a k <v k > (k=l~m) to /3 k <u k > (k=l~m) by the following method. That 
is, when each matrix of the base extraction vector<u k >, the 
expansion coefficient /3 k , the orthonormal basis vector< v k >and 
the scalar coefficient a k is represented by the formula (32), 



[Numeral 32] 



v = [v„v 2 ,...vJ 

a relationship of the matrix is represented by the formula (33) . 

[Numeral 33] 

UB = VA (33) 

In order to solve the formula with respect to the matrix 
B, both sides of the formula (33) is multiplied from the left 
by a transposed matrix U T of the matrix U as shown by the formula 
(34) . 

[Numeral 34] 

U T UB = U T VA (34) 

The matrix (U T U ) is expanded to be the formula (35) . 

[Numeral 35] 



B = 



'A 

A 



A = 



a, 



a, 



(32) 
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L U «*J 



[ U »> U 2,"-U„,] 



U, • U, u, mu 2 



(35) 



In the formula (35), <u ± * uj >means an inner product, 
and a square matrix which is a symmetrical to a diagonal element 
is obtained because<ui ■ Uj >is equal to <Uj * u ± > , and an inverse 
matrix exists because< u A > i s different from<Uj> . Therefore, the 
inverse matrix (U T U) 1 of the matrix (U T U) is multiplied from 
the left of both sides of the formula to obtain the formula (36) 
and 0 k is calculated. 



[Numeral 36] 

(U T U) 1 U T UB = B = (U T U) 1 U T VA (36) 

As explained above, it is unnecessary by transforming 
the group of the orthonormal basis a k <v k > (k=l~m) to the 
non- orthonormal basis £ k <u k > (k=l~m) that each base extraction 
vector<u k >is subjected to orthogonal transform in decoding side 
every time, and the differential vec tor < dj > can approximate by 
adding a multiplied value of them and $ k . Thus, the decoding 
processing can be simply carried out at high speed. 

A compression encoding processing of the expansion 
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coefficient 0 k will be explained. 

Fig. 13 is an image drawing of a compression encoding 
processing of the expansion coefficient. In Fig. 13 (a) , a norm 
is extracted from the produced 0 x ~ /? 4 . In Fig. 13 (b), a norm 
5 is arranged, for example, in ascending order ( 0 3 , 0 2 . 0 a . 
0 1 ) and a difference ( A £ 3 , A 0 2 , A 0 4 , A 0 1 ) is calculated . 
In Fig . 13 (c) , the upper bits are separated by removing the 
lowest two bits from all bits in the difference of coefficient 
(A 0 3 , A 0 2 , A 0 4 , A 0 1 ) , and are sub j ected to Hoffman encoding . 

10 In the example, two groups of A 0 3 and ( A 0 2 , A 0 4 , 

A 0 1 ) exist with respect to the value, and according to Huffman 
encoding, a code sign of less bit numbers is allotted to (A 
0 2 , A#4 , A# x ) of which generating frequency is more and 
a code sign of more bit numbers is allotted to A 0 3 of which 

15 generating frequency is less. Accordingly, the compression 
encoding of expansion coefficient 0 k is possible. Also, 
fractions of the lowest bits are omitted by Huffman encoding 
of the upper bits in difference A 0 k of the coefficient, whereby 
possibility of A0 2 = Ay3 4 = is high in the upper bits as 

20 shown in Fig. 13 (c) . 

The lowest two bits of difference A/3 k is packed with 
positive and negative code sign bits and an index information 
(13 bits - 0 - 8191) of the basis vec tor s < u k > corresponding to 
the sign bits in a code sign area of 2 bites fixed length and 
25 is output as the fixed length code sign. The output is carried 
out in the order of AjS 3 , A 0 2 , A 0 4 and A 0 1 (i.e. u 3 , u 2 , 
u 4 , Ui) . 

In Fig. 13 (d), each code sign is input in the order of 
u 3 , u 2 , u 4 and Ui in decoding side, from which each of the 
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coefficient A/3 3 , A 0 2 , A/3 4 and A 0 2 is separated. Further, 
/? 3 is decoded from the first A 0 3 , /3 2 is decoded by adding 
A /3 2 to the decoded 0 3 * £ 4 is decoded by addingA# 4 to the 
decoded 0 2 * and then 0 i is decoded by adding A 0 1 to the decoded 
5 0 4 . The decoding order is not important because /3 k <u k >is 
functioned based on the sum (linear bond) of these values. 

The difference can be calculated by arranging the norm 
in descending order instead of the ascending order. 

The coding processing by the encoding unit 34 will be 

10 explained. A prediction difference AdC J(I of DPCM is quantized 
by a quantization coefficient Q (Z), and only in case that A 
DC JfI is 0, run length coding is considered, and the prediction 
difference AdCj,i and the run length coding each is independently 
subjected to Huf f man coding . Only in case that the basis number 

15 k is 0, the run length coding is considered, and the basis number 
k and the run length each is independently subjected to Huffman 
coding. The coefficient difference A 0 k is quantized by a 
constant number Q (e.g. 8) to obtain its quotient, which is 
sub j ected to Huffman coding . The code sign bits of the expansion 

20 coefficient 0 k and the lowest two bits of the coefficient 
difference A 0 k are incorporated in the code information i ( = 13 
bits) of the basis vector<u k >to make the fixed length coding 
sign of 16 bits, which are incorporated in the coefficient 
difference A 0 k in ascending (or descending) order and is 

25 transmitted. As a whole, row of the coding sign is constituted 
by incorporating these in appearing order per unit of pixel block . 
If necessary, a sign EOB is input to show change of pixel blocks. 

Fig. 14 is a block diagram showing an image decoder, which 
is an embodiment of the invention, and corresponds to the image 
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encoder as shown in Fig. 6. In Fig. 14, 41 is a decoding unit 
by Huffman, etc., 42 is an alternating current component 
prediction unit for predicting target blocks < Rj > containing the 
alternating current component from the surrounding DC values 
DCj' containing the noticeable pixels DCj, 43 is the differential 
vector reproduction unit for reproducing an approximate 
differential vector<dj>based on the decoding basis /3 k <u k > 
(k=l~m), 44 is the Rj reproduction unit for reproducing target 
blocks < Rj >based on the decoding blocks<Rj>, 45 is the reproduced 
image memory, 46 is the IDPCM unit for IDPCM decoding the decoded 
DC value, 47 is the DC image memory for storing the DC nest, 

48 is the DC nest production unit which is same as in Fig. 2, 

49 is the DC nest memory for storing the DC nest, 50 is the selected 
block buffer for holing the selected blocks<U k >which are 
down-sampled from the DC nest, 51 is a multiplier for 
mul tiplying<U k >by /9 k , 52 and 53 are the cumulative addition 
unit of @ k <u k > (k = l~m), 54 is a means for obtaining a block 
mean value Aj of cumulative addition values, 55 is a subtractor 
for separating the block mean value Aj of cumulative addition 
values , 56 is an approximate vector buffer for holding reproduced 
approximate differential vector<dj>, and 57 is a means for adding 
the reproduced approximate differential vector<dj>. 

In Fig . 15 , which is a flow chart showing an image decoding 
processing of an embodiment of the invention, the image coding 
data is input at step S101. At step S102, each DC value in Y, 
U and V is decoded by IDPCM method similar to Fig . 6 and DC images 
are reproduced. At step S103, DC nest is produced from the DC 
value of Y component. At the time, as shown in fig. 7, the lowest 
four bits of each DC pixel value DC a are masked to be each DC 



nest pixel value N a . The information such as cut position of 
the DC images is separately received. At step S104, the index 
counters j and J to the original image memory 45 and DC image 
memory 47 are initialized to 0. 

At step S105, coding data of one block image is input. 
At step S106, it is judged that k is 0 or not. In case that 
k is 0 , thetarget blocks <Rj >are reproduced by alternating current 
prediction method as described hereinafter. In case that k is 
not 0, it is judged at step S107 whether k is not less than 1 
and not more than 4 or not. 

In case k is not less than 1 and not more than 4, the 
differential vector<dj>is inversely quantized at step S112. 
Since the lowest four bits of the DC nest are previously masked 
in the embodiment of the invention, the differential vec tor < dj > i s 
obtained at once by cumulatively adding the product of the 
selected block<U k >and 0 k and by separating the block mean value 
Aj from the cumulative addition result, whereby the decoding 
processing is carried out at high speed. At step S113, the DC 
value DCj corresponding to thus obtained differential 
vector<dj>is added. 

In case k is less than 1 and more than 4, the target 
blocks<Rj >are directly produced from the decoding data of the 
target blocks<Rj>at step S108. Thus, the target blocks<Rj>of 
4 times 4 pixels are reproduced by any methods as above. The 
reproduced target blocks <Rj >are stored in the reproduced image 
memory 45 at step S109. 

At step S110, "1" is added to the counters j and J, 
respectively, and at step Sill, it is judged whether i is not 
less than M (all pixel block numbers) or not. In case that i 



is less than M, turning to step S105 and the decoding and 
reproducing processing is carried out with respect to subsequent 
the block image coding data. When the same procedure was 
proceeded and j is not less than M in the judge at step Slll # 
5 the decoding processing per one image is terminated. 

Fig. 16 is an image drawing of an alternating current 
component prediction, which is an embodiment of the invention 
and is applicable for conventional prediction methods. 

Fig. 16 (A) is a stepwise alternating current component 
10 prediction method as described hereinafter. At first stage, 
each sub-block Si - S 4 is predicted from each DC value of the 
4 blocks (U, R, B, L) surrounding the S x ~ S 4 . 

51 = S + ( U + L B R) / 8 

5 2 « S + ( U + R — B — L) / 8 
15 S 3 = S + ( B + L — U — R) / 8 

S 4 = S + ( B + R — U — L) / 8 

Similarly, U 1 ~ U 4 , L x - L 4 , Ri - R 4 and B x ~ B 4 are predicted 
at the first stage. At second stage, 4 pixels P x ~ P 4 on Si are 
predicted by using the above method repeatedly. 
20 Pi = Si + ( U 3 + L 2 — S 3 -S 2 ) / 8 

P 2 - Si + ( U 3 + S 2 — S 3 ~ L 2 ) / 8 
P 3 = Si + ( S 3 + L 2 ~ U 3 ~ S 2 ) / 8 
P4 = Si + (S 3 + S 2 — U 3 — L 2 ) / 8 

Each 4 pixels Pi - P 4 on S 2 - S 4 are predicted in the same 
25 manner. The target blocks < Rj > are reproduced by such two stage 
processing . 

Fig. 16 (B) is a non-stepwise alternating current 
component prediction method, which the applicant has been already 
proposed. In Fig. 16 (B), each of the 4 pixels Pi - P 4 on each 
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of the sub-block S 1 ~ S 4 is predicted from each DC value of 4 
blocks surrounding the noticeable block S at a stroke. At first, 
each approximation of S 2 =^S 3 ^S, u 3 ^U 2 and L 2 ^L is carried out 
to obtain each 4 pixels P x - p 4 on S x . The approximation is applied 
to Pi ~ P 4 on Si to obtain the formula, 
Pi - Si + ( U 3 + L 2 — S 3 — S 2 ) / 8 
= Si + ( U + L S — S ) / 8 

The above formula, Si = S + ( U + L — B~ R) / 8, is substituted 
for the formula, P x = Si + ( u + L~S~S ) / 8, V 1 on S 1 is finally 
represented by the formula, 

Pi = S + ( 2U + 2 L 2S — B — R ) / 8 
And, P 2 on Si is represented by the formula, 
P 2 = Si + ( U 3 +S 2 — S 3 — L 2 ) / 8 
= Si + ( U + S — S — L ) / 8 

The above formula, S x = S + ( U + L B R) /8, i s subs ti tu ted 
for the formula, P 2 = S x + ( U + S-S-L ) / 8 , P 2 on Si is finally 
represented by the formula, 
P 2 = S + ( 2 U B R ) / 8 

Also, P 3 on Si is represented by the formula, 
P 3 = Si + ( S 3 +L 2 — U 3 — S 2 ) / 8 
= Si + ( S + L — U — S ) / 8 

The above formula, Si = S + ( U + L B R) /8, is substi tuted 
for the formula, P 3 = Si + ( s + L~ U~ S ) / 8, P 3 on S x is finally 
represented by the formula, 
P 3 = S + ( 2 L B — R ) / 8 
Further, P 4 on S x is represented by the formula, 
P 4 = Si + ( S 3 +S 2 — U 3 — L 2 ) / 8 
= Si + ( S + S-U-L ) / 8 

The above formula, Si = S+ ( U + L~B — R) / 8, is substituted 
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for the formula, P 4 = Si + ( S + S U L ) / 8, P 4 on 3 X is finally 
represented by the formula, 
P 4 = S + ( 2 S — B — R ) / 8 

Accordingly, 4 pixels P x ~ P 4 on s x can be non-stepwise 
5 obtained by the formulae at a stroke. 
Pi = S + ( 2U + 2 L 2S B — R ) / 8 
P 2 = S + ( 2U-B-R ) / 8 
P 3 - S + ( 2L — B — R ) / 8 
P 4 - S + ( 2S — B — R ) / 8 
10 Each 4 pixels P x ~ P 4 on S 2 ~ S 4 is obtained in the same manner. 

The embodiments of the invention are explained by using 
the several examples, but it is apparent that the invention should 
not be limited thereto . It is to be appreciated that those skilled 
in the art can change or modify the embodiments in such point 
15 as construction, control, processing or a combination thereof 
without departing from the scope and spirit of the invention. 

According to the invention, high image quality can be 
obtained by the improvement of the DC nest and high speed encoding 
can be achieved by the means for the AOT calculation . Therefore , 
20 the method of the invention much contributes to the attainment 
of high image quality and high speed encoding in the HVQ system. 
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